Part of the problem might be "buffer bloat". Instead of dropping packets, and thus throttling back on upload or download speed, in a timely manner so devices share the internet equally, router buffers fill up in increase latency before dropping packets. Thus things like Skype or web surfing, where latency is more important that having a LOT of bandwidth.