Not really. The thing is, the Sorrows and the Dead Horses deserve to be left alone in their home. Joshua Graham lets them defend themselves and try to claim his home finally in Zion, they need to learn defend themselves and he's the best teacher they could have for this type of survival.
Also, considering the story of Randall Clark, the Survivalist and Father of the Caves, and the final message of leaving Zion to the children of the tribe. Defending Zion from the White Legs is just the right thing to do.
Daniel is a faggot, he unintentionally treats the Sorrows and Dead Horses like they're animals, even when he means no harm, talking about innocence and their kindred spirit is not gonna do shit when you have a tribe of savages and killers wanting to hunt them to please Caesar. Having them run away from Zion, one of the few safe-ish places in United States after the war, and go to who knows what horrible place awaiting them is just going to be the end of their tribe in the long run. Running away from them is not the solution, it only makes the tribe of savages stronger.
Basically, Team Joshua all the way.