Congress chief Mallikarjun Kharge on Sunday accused PM Narendra Modi and the ruling BJP of breaking the unity of the country.