Skip to content

Which LLM provider should I choose?

Admin

CompanyWizard ships no model of its own — you bring the access. In time, Managed AI takes that off your hands: there, access, key and models come with the licence, billed against a hard monthly budget. During the beta phase Managed AI cannot be booked yet, so you add a key of your own (bring your own key). Before you do (how), answer the question that comes first: which provider fits your data-protection situation? This page compares the provider types — as a properties matrix, not a yes/no verdict.

ColumnMeaning
Data locationWhere prompts and responses are processed. EU / US / configurable (region selectable) / China
DPAData processing agreement available: yes / on request / no
Zero-retentionNo storage of inputs/outputs after the response: yes / opt-in / check
Third-country/SCCData transfer outside the EU, standard contractual clauses + transfer impact assessment required: yes / no / depends on region / check
TypeDirect (provider hosts models) · Aggregator (router across many models) · Hyperscaler (cloud platform)
CW setupStandard = enter key (how) · otherwise a dedicated article

As of July 2026. Provider offerings change — verify critical cells at the source before deciding.

Cortecs.ai (Cortecs GmbH, Vienna) is the aggregator our Managed AI package runs on as well — and the only entry in this matrix that offers both routing modes: processing in the EU, or EU-native providers only. If you want to keep the choice between data residency and true sovereignty open, this is the shortest path.

ProviderData locationDPAZero-retentionThird-country/SCCTypeCW setup
Cortecs.ai (EU data residency)EUyes¹yesdepends on model²AggregatorStandard³
Cortecs.ai (EU sovereign)EU (EU-native providers only)yes¹yesnoAggregatorStandard³

¹ With Managed AI through evanto, with Cortecs as a sub-processor; with a key of your own you sign the DPA with the provider directly — on request. ² EU data residency means processing happens in the EU. The model provider behind it may be established outside the EU — the sovereign variant rules exactly that out, at the price of a smaller choice of models. ³ Enter the key as for any OpenAI-compatible provider, endpoint https://api.cortecs.ai/v1/. → Where do I get an LLM API key?

As of September 2026.

Providers with an EU data location as the starting point. Even so: sign a DPA and check the retention setting. For Mistral, DPA, zero-retention and the third-country question deliberately read check: that Mistral counts among the EU-native providers is evidenced for the chain of our Managed AI package — for a contract of your own with Mistral we have no source. Verify all three at the source before you add the key.

ProviderData locationDPAZero-retentionThird-country/SCCTypeCW setup
Cortecs.aiEUyesyesdepends on modeAggregatorsee group 0
IONOS (AI Model Hub)EU (DE)yesyes¹noDirectSet up
Mistral AIEU (FR)checkcheckcheckDirectStandard
EU-RouterEU²on requestyesnoAggregatorSet up
Scaleway (Generative APIs)EU (FR)yesyes (default)noDirectSet up
Requesty.aiEU (Frankfurt)on requestopt-innoAggregatorSet up

¹ IONOS operates statelessly — prompts/responses are discarded after the session, not used for training, and no data leaves Germany. ² EU-Router is an OpenAI-compatible EU gateway: the EU data location depends on the routing rule you choose — you create it at the provider first and store it as a custom field in CompanyWizard. Details in the setup article.

The strongest models, US processing by default. EU use is possible but not the default — depending on the provider it requires an EU region, an enterprise contract, and SCCs.

ProviderData locationDPAZero-retentionThird-country/SCCTypeCW setup
OpenAIUS (EU region possible³)yesopt-in³yes³DirectStandard
Anthropic (Claude)US⁴yesopt-in⁴yesDirectStandard
xAI (Grok)USon requestcheckyesDirectStandard

³ OpenAI offers European Projects with in-region processing and zero-retention; without that option, US processing + SCCs are required. ⁴ Anthropic processes in the US by default; zero data retention only with an enterprise/team key. Native EU residency only via Bedrock/Vertex EU regions (see group 3).

Frontier models through your cloud platform — with a selectable EU region and the DPA of your cloud contract. Setup usually needs region, project/deployment ID; see AI models / providers.

ProviderData locationDPAZero-retentionThird-country/SCCTypeCW setup
AWS Bedrockconfigurable (EU)yesyesdepends on regionHyperscalerProviders
Google Vertex AIconfigurable (EU)yesyesdepends on regionHyperscalerProviders
Azure OpenAIconfigurable (EU)yesyesdepends on regionHyperscalerProviders

Models are not used for training; the data location follows the selected region. The US parent company may, depending on interpretation, establish a third-country transfer — clarify with your data protection officer.

ProviderData locationDPAZero-retentionThird-country/SCCTypeCW setup
OpenRouterconfigurable / UScheckopt-inyesAggregatorStandard
z.ai (Zhipu / GLM)Chinanocheckyes ⚠️DirectStandard

For aggregators (OpenRouter) the routing rule determines the actual data location — the matrix classification applies only to the default configuration.

Once you have decided, move on to the mechanics: Where do I get an LLM API key? describes how a key is created and stored encrypted in CompanyWizard. Provider management itself lives under AI models / providers.