We have under 10 people sometimes for World Bosses in my realm. I'd say server merging would be rather fantastic and breathe new life into things. Even better if power levels were similar between merged servers.