You must manually set your passwords to be secret when editing the specific record. If the record with a secret password is shared with a team, it will remain secret to all non admins of the team.
Admins will of the record will always be able to view and edit secret or masked fields.