diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md
index 684aa087..80f5773e 100644
--- a/CONTRIBUTING.md
+++ b/CONTRIBUTING.md
@@ -90,7 +90,9 @@ following section *completely*. Thank you! :)
    the people maintaining them instead.
 
 2. Please make sure to **test out the current version** of OctoPrint to see
-   whether the problem you are encountering still exists.
+   whether the problem you are encountering still exists, and **test without
+   any non-bundled plugins enabled** to make sure it's not a misbehaving
+   plugin causing the issue at hand.
 
    If you are feeling up to it you might also want to try the current development
    version of OctoPrint (if you aren't already). Refer to the [FAQ](https://github.com/foosel/OctoPrint/wiki/FAQ)