It is possible to register a company either in Finnish or Swedish, and handle all the bureaucracy in Swedish. At InfoFinland you will find information on how to start a company in Finland.
There is an interest and service organisation for Finnish small and medium-sized enterprises (SMEs) and their owners called Företagarna i Finland. They organise events and have a variety services for their members.
Helsinki city will also help you to establish a company in Helsinki, more information at Business Helsinki.
Startup Refugees is a non-profit organisation established in 2015 to support refugees, asylum seekers and other migrants in employment and entrepreneurship.