He accused the Congress of setting new records of corruption, inflation and misrule during its 55-year of government post-Independence.
Singh, while campaigning for Kalraj Mishra who is contesting from Deoria, said, "Although SP, BSP and Congress appear to be different party, they are all one. The join hands after elections to form government."
He said SP and BSP are equally responsible for inflation and corruption and appealed to the people to "punish" these parties during the elections.
Singh said Congress and other parties are frustrated because of growing popularity of Modi and BJP.
The BJP president said there are serious security issues facing the country.
"The borders are not safe during the UPA rule. Indian soldiers were killed but government remained a mute spectator," he said.
Deoria will be going to polls in the last leg of elections to be held on May 12 where Mishra is facing contest from Niyaz Khan of BSP, Baleshwar Yadav of SP and Sabha Kumar Kushwaha of Congress.