We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update create_pod_config to reference tokens from K8s Secret resources in the container's environment variables, eg.:
create_pod_config
Secret
apiVersion: trustyai.opendatahub.io/v1alpha1 kind: LMEvalJob metadata: name: evaljob spec: model: local-completions taskList: taskNames: - mmlu logSamples: true batchSize: 1 modelArgs: - name: model value: granite - name: base_url value: $ROUTE_TO_MODEL/v1/completions - name: num_concurrent value: "1" - name: max_retries value: "3" - name: tokenized_requests value: "False" - name: tokenizer value: ibm-granite/granite-7b-instruct pod: container: env: - name: OPENAI_API_KEY valueFrom: secretKeyRef: name: <secret-name> key: token
The text was updated successfully, but these errors were encountered:
christinaexyou
No branches or pull requests
Update
create_pod_config
to reference tokens from K8sSecret
resources in the container's environment variables, eg.:The text was updated successfully, but these errors were encountered: