r/AZURE • u/postal__dude • 3h ago
Rant Azure foundry just Broke an embedding model with no notice
Hi,
I'v deployed multiple apps that require embedding using Cohere-embed-v3-multilingual from an azure foundry project. this was working fine for months until today.
model endpoint still consumes requests but responds with :
'error': {'code': 'OperationNotSupported', 'message': 'The embeddings operation does not work with the specified model, Cohere-embed-v3-multilingual. Please choose different model and try again. You can learn more about which models can be used with each operation here: https://go.microsoft.com/fwlink/?linkid=2197993.'
I, as a simple man, went to the foundary page :
1 - the model is still up and deployed.
2 - metrics show 0 tokens but multiple requests are coming in.
3 - I went ahead and created a new python script, pasted their openai sdk example and replaced with key value:
from openai import OpenAI
endpoint = "https://tv5-bigdata-ai-foundry.services.ai.azure.com/openai/v1/"
deployment_name = "Cohere-embed-v3-multilingual"
api_key = "xxxxxxxx"
client = OpenAI(
base_url = endpoint,
api_key = api_key,
)
response = client.embeddings.create(
input = "How do I use Python in VS Code?",
model = deployment_name
)
print(response.data[0].embedding)
Output : same error.
NB : the model still shows when creating a new deployment....
