Topics tagged with database

Facing duplicate key errors on high load

joshua — Invalid Date

Internal Note: tracking via https://github.com/FusionAuth/fusionauth-issues/issues/1231

Too many connections error with mysql

dan — Invalid Date

And now it works fine with 152 threads connected, so unable to reproduce this.

I'll keep an eye out for this behavior and file an issue if it pops up again.

For the record:

FusionAuth 1.27
installed via zip file
Mysql 8.0.23 installed/managed via homebrew on the mac.

Are the post and get forms of the user search API equivalent?

dan — Invalid Date

Yes, they are equivalent. Building this JSON:

{ "search": { "queryString": "fusionauth.io" } }

and posting it is equivalent to a GET with queryString=fusionauth.io.

Can you use the database search engine with millions of users?

dan — Invalid Date

I don't know of any issues. You’re mainly just giving up the ability to perform rich queries. The db search is a few LIKE statements.

I don't think we've tested millions running db search - but the only issue I can think of for normal usage would be the User page in the UI since we’ll be paginating over lots of users.

This should work ok - but pagination tends to slow way down as you get into higher pages,.

One can always flip on Elastic and run an index, so not much harm in trying it.

Upgrade issue from 1.21 -> 1.22

[[global:former-user]] — Invalid Date

Added missing db migration notices for 1.21.0 and 1.22.0.

how to get fresh installation?

dan — Invalid Date

Sorry, no kub expert here. I'm not sure how to teardown just the database, but I assume you could write a script to connect to the backing database and drop the tables/schema, etc. That might be quicker than dropping the entire cluster.

If you figure out a better way, please share!

Retrieving ids from FusionAuth database tables

dan — Invalid Date

Hiya,

We don't guarantee any database level compatibility (which is why we recommend doing everything through the API, which does have those guarantees).

But here's an option. I'm assuming you are using MySQL. FusionAuth uses UUIDs for unique Ids, and in MySQL we store these as BINARY(16).

If you want to select this value in a human readable form, you can perform a select such as SELECT HEX(id) FROM table_name.

If you want to select this column and deserialize it into a Java UUID type, you can use code similar to the following:

public UUID fromByteArray(byte[] ba) { long msb = 0; long lsb = 0; for (int i = 0; i < 8; i++) { msb = (msb << 8) | (ba[i] & 0xff); } for (int i = 8; i < 16; i++) { lsb = (lsb << 8) | (ba[i] & 0xff); } return new UUID(msb, lsb); }

Another option, depending on your data size, would be to export all the data using the relevant APIs, and import it into your analytics database.

maximum pool size configuration

dan — Invalid Date

You can use the database.maximum-pool-size value in the fusionauth.properties file prior to 1.19.x ( it was just not documented) , but if you want to use the environment variable version is not available until 1.19.x.

what is the default connection pool size for the app?

[[global:former-user]] — Invalid Date

Also, see database.maximum-pool-size here https://fusionauth.io/docs/v1/tech/reference/configuration

Where is the configuration stored in the database?

dan — Invalid Date

There isn’t a single table in the db really. Configuration exists there, and in tenants, applications, etc.

How large can the data field be for any of the FusionAuth resources?

dan — Invalid Date

If you're using PostgreSQL the size is essentially unlimited. With MySQL it is 16 MB.

There are few exceptions to this rule where we may be using a 64 KB column if you're on MySQL.

I wouldn't recommend storing that much data however. If you're using Elasticsearch, the custom data on the User will be indexed, and Elasticsearch will eventually hit a limit as well.

Does FusionAuth require that you migrate your userstore into the product?

brennan.karrer — Invalid Date

@dan no problem at all. Completely understand it's tough offering support without reviewing how we have things setup.

Appreciate you shooting that link over and will do some investigation on our end to see what might work best for us.

Thanks!

Does FusionAuth support high availability database configurations?

kevin.mahoney — Invalid Date

@dan 160ms

Is it possible to set up DB replication using MySQL for FusionAuth db?

dan — Invalid Date

As long as your meet our minimum database requirements in theory it should work. I do know that MySQL Group Replication is not supported.