Rename `project_name` to `project_id`

Contents (#731)

IMPORTANT: There is 1 breaking change.

Refactoring

• 💥 BREAKING CHANGE: Rename project_name to project_id
• Remove unused test environment variable TEST_PROJECT_ID

Operations

• Stop using tox for CI tests

Dependencies

• Use version 0.16.0 of service communication schema
• Use twined=^0.7.0
• Remove tox

---

Upgrade instructions

💥 Rename `project_name` to `project_id`

Rename the project_name argument to project_id

Move app configuration into service configuration

Contents (#730)

IMPORTANT: There is 1 breaking change.

New features

• 💥 BREAKING CHANGE: Move app configuration into service configuration

---

Upgrade instructions

💥 Move app configuration into service configuration

• Move the contents of the app_configuration.json file into the octue.yaml file under the first item in the services list (make sure to convert from JSON to YAML)
• Remove the app_configuration_path argument from the octue.yaml file
• Use ServiceConfiguration.from_file instead of load_service_and_app_configuration
• Replace any uses of the app_configuration argument/variable with service_configuration

Fix google auth library imports and `grpcio` version

Contents (#729)

Fixes

• Fix google auth library imports

Dependencies

• Use new version of grpcio to avoid spurious warning

Switch to Kueue service backend

Summary

This release switches to running Twined services on Kubernetes + Kueue. This brings the following features:

• Queue questions so they're not just dropped if the service backend is overwhelmed
• Run questions that take any amount of time (specifically opening us up to runs > 1 hour)
• Request arbitrary compute resources per question (CPU, memory, storage etc.)
• Stop extraneous question reruns by allowing us to control when we acknowledge question events
• Monitor running questions individually
• Make it easier to run questions on providers other than Google in the future (i.e. on any Kubernetes cluster)

Contents (#723)

IMPORTANT: There are breaking changes.

New features

• #709 (see PR for list of breaking changes)
• Authenticate requests to service registries

Enhancements

• Add allow_not_found option to ServiceConfiguration.from_file
• Add default event store ID to get_events
• Increase default maximum heartbeat interval to 360s

Refactoring

• #721

Dependencies

• Remove gunicorn and Flask dependencies

Operations

• Replace Terraform configuration with new terraform-octue-twined-core module

Testing

• Move deployment test to octue/example-service-kueue repository

Improve output validation/upload logging

Contents (#691)

Enhancements

• Improve output validation/upload logging

Fixes

• Avoid attempting to upload output manifest if it's None

Log warning when runtime timeout is near

Contents (#690)

Enhancements

• Log warning when running on on Cloud Run and runtime timeout (1 hour) is near

Dependencies

• Add pydash dependency

Refactoring

• Replace custom nested attribute functions with pydash usage

Allow optional strands

Contents (#688)

New features

• Allow optional strands

Dependencies

• Use twined=0.6.0

Fixes

• Skip dataset validation for missing optional manifests

Add documentation on updating Octue services

Contents (#683)

Operations

• Use latest ruff pre-commit check

Dependencies

• Add ruff to dev dependencies

Other

• Add doc on updating an Octue service

Switch to ruff developer tooling

Contents (#682)

Operations

• Switch from flake8, black, and isort to ruff

Dependencies

• Remove old formatters/linters and add ruff config

Refactoring

• Apply ruff to all files

Check for service revision existence

Contents (#680)

IMPORTANT: There is 1 breaking change.

Enhancements

• 💥 BREAKING CHANGE: Use cloud URIs by default for datasets in output manifests
• Add comments around checking for service revision existence
• Improve error when octue.services topic doesn't exist

Fixes

• Raise error if service revision subscription doesn't exist when no service registry is in use
• Remove octue.services prefix from subscription names

Refactoring

• Avoid repeated conversion to Pub/Sub ID for a service

---

Upgrade instructions

💥 Use cloud URIs by default for datasets in output manifests

Set use_signed_urls_for_output_datasets to True in the app configuration to keep using signed URLs for datasets in output manifests.