GetBalance call very slow

```
server:~$ time litecoin-cli getbalance ""
1659.56383570

real    0m8.305s
user    0m0.000s
sys     0m0.000s
```
Everything else is running smooth and other RPC calls are instant.
Anything I should look out for?