Your channel is secured by the code which can be found in the options. Everyone who has the code can access the channel. If you are not sure who has access to your channel, just delete it and create a new one.