reduce bulk size in database writer, before "Prepared statement contains too many placeholders" appears #733
Description
when there are many dns requests incoming , there is no option to set the timeout for the logger ( thus flooding stdout ), already switched from csv to mysql ..
also "Prepared statement contains too many placeholders" appears under heavy load and dumps a very long single line to stdout
log:
2022-11-08 20:53:35] WARN query_logging_resolver: query log writer is too slow, write duration: 0 ms channel_len=502
2022-11-08 20:53:35] WARN query_logging_resolver: query log writer is too slow, write duration: 0 ms channel_len=501
2022-11-08 20:53:45] ERROR server: error on processing request:resolution was not successful, used resolvers: 'upstream 'https://dns.digitale-gesellschaft.ch/dns-query'' and 'upstream 'tcp-tls:fdns1.dismail.de'' errors: [can't resolve request via upstream server https://185.95.218.43:443/dns-query: http return code should be 200, but received 502 can't resolve request via upstream server [2a02:c205:3001:4558::1]:853: dial tcp [2a02:c205:3001:4558::1]:853: connect: cannot assign requested address]
2022-11-08 20:53:48] INFO /src/querylog/database_writer.go:136 Error 1390: Prepared statement contains too many placeholders
[361.971ms] [rows:0] INSERT INTO `log_entries` (`request_ts`,`client_ip`,`client_name`,`duration_ms`,`reason`,`response_type`,`question_type`,`question_name`,`effective_tldp`,`answer`,`response_code`) VALUES ('2022-11-08 20:53:29.486','127.0.0.1','127.0.0.1',17,'RESOLVED (tcp+udp:4.2.2.4)','RESOLVED','A','facebook.com','facebook.com','A (157.240.9.35)','NOERROR'),('2022-11-08 20:53:29.502','127.0.0.1','127.0.0.1',3,'RESOLVED (tcp+udp:1.1.1.1)','RESOLVED','A','youtu.be','youtu.be','A (142.250.179.142)','NOERROR'), ... ## more entries like this