Home Minister Rajnath Singh on Thursday came down on writers and some prominent persons returning their Padma and Sahitya Akademi awards terming it as a political conspiracy and wondered what these people were doing when there were communal riots during Congress rule.