Links from other websites to your blog [Incoming Links] cannot effect your Search Results, because they know you haven't control on them.
But how about Link to Other Spamming websites or malicious websites from your Blog ? Surely it will effect your Search Results [Google,Yahoo,Bing..] .
So you Should aware about your External Links, Text Link Checker Tool is one of the Best External Link Checker .You Jut needed to put your URL inside the Text-box and tool will automatically provide the scanned result .
Obviously you should use this to tool , there may be many spamming links from your blog and it will reduce your Result.Check It out!