Exclude undesired imports from being automatically imported or added to completion list.

In Settings/Preferences | Go | Imports you can add as many as you want import statements that will be excluded from code completion and auto-import.