He appears age 10 in the 1861 Census but by 1871 he is 20 and does not appear in that year's Census. This because he has moved out and is now a lodger at a house in Brewer Street, See below.
Looks like he had a second marriage, at age 30, to a Mary Ann East in 1881 because his marriage certificate below shows him at that time as a widower. Seems a child was born a year later, a daughter, Elizabeth Mary Ann Higgs.
The 1901 Census does not show him, he would be aged 50 by this time