To remove breakpoints by dragging them from the gutter, open settings by pressing &shortcut:ShowSettings;, go to Build, Execution, Deployment | Debugger and select Drag to the editor or click with middle mouse button.

Clicking a breakpoint will then toggle its status (enabled or disabled).