📦
CHI-in-a-box
  • What is CHI-in-a-Box?
  • Before You Begin
    • Assumed Knowledge
    • Hosts and Services
    • Network Overview
    • CC-Ansible
    • The site configuration
      • inventory
      • defaults.yml
      • passwords.yml
      • certificates/
      • node_custom_config/ (optional)
      • post-deploy.yml (optional)
    • How Deployment Works
    • Security considerations
  • Setup Guides
    • Evaluation Site
      • Bring up the Control Plane
    • Production Baremetal
      • Baremetal QuickStart
      • Host Networking Configuration
    • Troubleshooting
      • Networking
    • Verification Checklist
    • Dev-in-a-Box
    • Edge-in-a-Box
  • Reference
    • Chameleon Identity Federation
    • Ironic Flat Networking
    • Ironic Multi-Tenant Networking
    • Glance Image Storage
    • Resource Reservation
      • Default Resource Properties
    • Monitoring
      • IPMI Metrics
      • SNMP Metrics
  • Example Deployments
    • ARM/x86 mixed architecture
    • Edge computing/container testbed
  • Operations
    • Hardware management
    • Certificate management
    • Chameleon tools
      • Hammers 🔨
        • maintenance_reservation
      • Disk image subscription
      • Usage reporting
    • Troubleshooting
      • Known issues
        • Neutron (networking)
        • Nova (KVM)
        • Ironic (bare metal)
      • Instance networking diagnostics
      • Security incident triage
      • Troublesome Hardware
    • Alert runbooks
      • Cron Job No Recent Success
      • Instance Failure
      • Image Cache Space
      • Ironic Node Error State
      • Jupyter Server Launch Failure
      • MySQL Host Down
      • MySQL Replication Error
      • Node Exporter Down
      • Node Network Bridge Down
      • Node Network Bridge Low Traffic
      • Nova Ironic Instance Launch Failure
      • OpenStack API Down
      • PeriodicTask No Recent Success
      • Portal Down
      • Precis Parsed Events Low
      • Provider Conflict
      • Runbook Template
    • User support guide
    • Upgrading to a new Release
  • Development
    • Developing OpenStack Services
    • Dev-in-a-box
Powered by GitBook
On this page
  • Bootstrapping MariaDB fails
  • No internet (or disconnect) when executing the openvswitch/neutron role
Edit on GitHub
  1. Operations
  2. Troubleshooting

Known issues

PreviousTroubleshootingNextNeutron (networking)

Last updated 2 years ago

Bootstrapping MariaDB fails

MariaDB cluster is running, but is not reachable via HAProxy

This can happen if the haproxy user is somehow not configured for MariaDB. In particular, if the database_password is changed at some point during bootstrapping, this can get in to a bad state.

If just the haproxy user appears to be missing: try re-running ./cc-ansible deploy --tags mariadb and see if that helps.

If database update operations are failing: try resetting the root password.

  1. You can allow a local login by editing /etc/kolla/mariadb/my.cnf and adding skip-grant-tables and skip-network (the latter disallows network access, for security).

  2. Login via docker exec -it -uroot mariadb mysql

  3. Update all of the root user passwords to your new password. Follow for how to do this.

If other database operations (like creating DB users for other OpenStack services) work: try manually creating the haproxy MariaDB user.

  1. Login via docker exyec -it -uroot mariadb mysql -p and provide the (unencrypted) root password (database_password in your passwords.yml).

  2. Create a 'haproxy'@'%' user with an empty password. This is what the automation is supposed to do. Then perform a GRANT USAGE ON *.* to 'haproxy'@'%'; FLUSH PRIVILEGES;

  3. Log out of the MariaDB container. You can now try to redeploy HAProxy.

No internet (or disconnect) when executing the openvswitch/neutron role

During the course of provisioning the IP addresses on the interfaces will move to the OVS bridges created by Neutron; this causes remote connections to terminate. Try running the initial run in a tmux or screen session (or via an IPMI console.) If there are still issues:

  • Ensure the physical interface is added as a port on br-ex using ovs-vsctl show. This should be performed during the application of the openvswitch. If not, to manually add, try doing docker exec openvswitch_db ovs-vsctl add-port br-ex <public_interface>

  • Modify /etc/sysconfig/network-script/ifcfg-<public_interface> to make this persist on boot.

MariaDB docs