The size of the list of Cells is controlled by the Size field, as the size is determined by the width, height and depth of the Brush, rather than the size of a list.
The inspector for the GameObject Brush uses the default inspector for the elements in each cell. Unfortunately, this cannot be changed to remove the additional UX which changes the size or add elements.