Contacts are unique records and for any given account you can have hundreds of contacts. Accounts are unique records and for any given account you might have a parent account, grandparent account etc.
Rolling up Notes is a design consideration that ties to your business process.
Anne