Habitational name for a person from the town of Elsworth in Cambridgeshire. The town's name is derived from the masculine given name Ella (a short form of Old English names beginning with the elements ælf meaning "elf" or eald meaning "old") combined with worþ meaning "enclosure".