See article:
Known to work:
Search for and delete the following registry subkeys:
Word Preview: HKCR\CLSID\{84F66100-FF7C-4fb4-B0C0-02CD7FB668FE}
PowerPoint Preview: HKCR\CLSID\{65235197-874B-4A07-BDC5-E65EA825B718}
Excel Preview: HKCR\CLSID\{00020827-0000-0000-C000-000000000046}
Close Registry Editor, and restart Windows.