The ironic thing about the Left getting mad at Empire-lovers is the fact that they ignore what Lucas said on the matter. Lucas not only based the Empire on Nazis, Romans, and the British, but he also based it on the USA, specifically Cold War USA under the Nixon era. He even compared the Rebels and Ewoks' victory over the Empire to the Vietcong fighting the USA forces in Vietnam. It's hard to fully hate the enemy when they're partially based on you. The Empire isn't just Space Nazi central; it was partially based on Cold War America, which many people still see as the good guys.
And it goes double for British people and Roman Empire fans; the Brits themselves played the Imperial March in one of the Queen's royal gatherings because they knew the Empire was partially based off them, especially when the entire Imperial officer class speaks with posh English accents. Roman Empire fans obviously admire an Empire that had quick coordination and near-endless reserves of soldiers for their legions. Not to mention the Emperor's Royal Guards were a dead ringer for the old Praetorian Guard.
Lucas further compounds the idea that Imperials can be empathized with when a kid asked him if the Stormtroopers were the bad guys. Lucas instead responded that the Stormtroopers were good people working for a bad man. (ie. Vader and Sidious) So it's practically Word of God that the Imperials are just as human as their Rebel counterparts, and the great tragedy is that them and the Rebels would be friends if it wasn't for their bosses. Hence why it's called the Galactic Civil War, because it's a society of people who would otherwise be like-minded, torn in half fighting each other, because of dueling allegiances.
There's also the fact that the Empire is the one faction that relies upon the great masses of enlisted people to fight for them; the Rebels just grab whatever dissidents they can grab, along with the minions of whatever rich prick joins them. The Republic used clone slave soldiers led by indoctrinated Jedi Janissaries. The Separatists used a few organic officers and mercenaries leading droid legions. The Empire provided for the populace a way to get paid and shared with them the power to enforce the law, in the form of making the recruits who came from the people into the Empire's metaphorical hands and fingers. You're not just fighting unfeeling zealots or Dark Side minions; you're fighting regular Joes who signed on the dotted line because they thought they were fighting for order and peace, and after centuries of a Republic government basically letting things slide into chaos while having the Jedi babysit them, it was a refreshing change of pace, the occasional war crimes notwithstanding.
Plus, it's not that hard to convince them to commit genocide, when the Republic basically did the same thing multiple times, even when the Jedi were watching over things. Most of the Empire's war criminals were former Republic officers who weren't that unfamiliar with the idea of bombing people back into the stone age. Base Delta Zero, the Empire's version of Warhammer 40K's Exterminatus, was originally a REPUBLIC protocol. The Empire just adapted that to their own systems.
So the Left getting mad at Empire fans and acting like the Imperials are a bunch of irredeemable, unfeeling monsters forget the fact that the Empire is, quite ironically enough, the most human out of all the factions. They provided the jobs to the most humans in the galaxy out of any faction, especially when in the SWEU, the New Republic provided less jobs, (their army, navy, and government was far smaller) and in the new canon, the New Republic uses droids for things like security and psychiatric help. The Republic's Jedi used clone troopers or whatever volunteers they can scrape off the streets, putting them under the command of religiously indoctrinated zealots who have been taught to subdue their own emotions. (You know, the things that make you human?) The Confederates used droid armies provided by shady corporations who were already doing the same evil things the Empire would later do, before they seceded from the Republic.
Is it any wonder that some people sympathize with the Empire, no matter what the authors from both the SWEU and Disney do?