Please see the link below to the NHS website with information on what your GP can and cannot do with regards to returning to work earlier than the date stated on your fit note:

https://www.nhs.uk/chq/Pages/2559.aspx?CategoryID=87&SubCategoryID=87