It doesn't so anything until you say those three key words. So it's always listening for Okay Google Now, not everything you talk about. I personally trust Google more so with my data than any other company out there. They are pretty up front with what they don't and you can always opt out if you don't like it. Unlike Apple or Facebook etc. , now that would be scary if they did this.
This messsege brought to you by Sprint and the letters GS and the number 4