I’d say that reason is not the disorder itself but rather your behaviour that is likely a result of having that disorder. That may be seen as ableism, but as your behaviour seems counterproductive I would say it’s correct to restrict you from participation until you achieve some ways of less toxic communication