Hiding the widget from the site is quite simple. Here's a step-by-step instruction.

​Step 1. Log into your account.

Step 2. Click on 'Manage' button.
​Step 3. Go to the 'Customize' section.

Step 4. Click on the field with the person icon.

Step 5. Select the "plus" in the icons menu. This will create a 'Custom Anchor Selector' field that you should leave empty.

Step 6. Scroll down and select "None" for the 'Icon Position' field.

Step 7. Click "Save" and you're all set. The widget icon will no longer appear on your site.