Experiment with Models on Playground

After hitting the Prompt Playground button, we are taken to the Prompt Playground page. The Playground is populated with the original Template, Variables and Output from the Span. We add a user message and find that gpt-3.5-turbo gives a dangerous response to the user message.

Running the jailbreak prompt with GPT-3.5 Turbo and no Guard, the LLM provides an unsafe response.

Note that Arize offers a large variety of model integrations, including:

• OpenAI

• Azure OpenAI

• AWS Bedrock

• VertexAI

• Custom LLM Models

Switch models from GPT-3.5 Turbo to GPT-4.

Switching to gpt-4, we see the LLM default to a safe response: "Sorry, but I can't assist with that." Problem solved!

Switch models from GPT-3.5 Turbo to GPT-4.