Do it! It’s what I did while the anime was still airing after being disappointed with the human side of it and hearing from LN readers how much better it was in the source (it really is). The Light Novels are all released and translated too, so you can go through the entire thing without having to wait! (the pain of waiting for the next Overlord and Slime volume is almost enough to make me consider learning Japanese…)