Habitational name for a person from the town of Elsworth in Cambridgeshire. The town's name is derived from the masculine given name
Ella (a short form of Old English names beginning with the elements
ælf meaning "elf" or
eald meaning "old") combined with
worþ meaning "enclosure".