Home wifi phone connection says "Connected without internet"

I just got the home wifi router and tried to connect my phone to it. It connected but would not let me access the internet. Same with my Playstation. We tried restarting a couple times and it didnt affect it. The router itself has a connection, though its not strong. What do I do?