There's not really a supported way to modify the FusionAuth logging format.
In theory you could do it manually but dropping in your own version of logback.xml and adding the necessary jars to the classpath.
Here is an example of JSON with logback. https://github.com/larose/logback-json-example
I think you’d have to add in the JSON logback jar since we do not ship with it.