You can use the IMPORT/EXPORT icon to import all contacts including your groups.  When removing an individual that is part of your group you must delete their name from ACCOUNTS>CONTACTS>INDIVIDUALS.  This will remove them from your group list.