Release v0.52.3

IMPROVEMENTS

• sources/csl_us: split names better from various programs
• search: allow filtering by sourceID
• sources/csl_us: fixup address extraction
• ingest: guard against slices.Ingest not finding the needle

Full Changelog: v0.52.2...v0.52.3

Release v0.52.2

What's Changed

• download: error when unknown lists are provided in the config by @adamdecaf in #633
• search: error requests when extra/unused query params are supplied by @adamdecaf in #634
• fix(deps): update opentelemetry-go monorepo to v1.36.0 by @renovate in #636
• search: stop requiring type param by @adamdecaf in #637
• sources/csl_us: read CSV from trade.gov by @adamdecaf in #638

Full Changelog: v0.52.1...v0.52.2

Release v0.52.1

IMPROVEMENTS

• docs: include source data in openapi spec
• ingest: log how many File templates are read
• search: read/set source (SouceList) query param
• sources/display: don't set ?source=api-request

Release v0.52.0

This release of Watchman adds support for ingesting CSV files as datasets, improved address similarity scoring, returning the original query in search results, and consolidating the web interface in the server binary / docker image along with several bug fixes.

ADDITIONS

• download: read DOWNLOAD_TIMEOUT from environment, default to 45s
• ingest: support arbitrary CSV via configuration as datasets
• search: return the original query
• sources/display: add DetailsURL for getting linkable Entity pages

IMPROVEMENTS

• api: add test for ErrorResponse and JsonResponse
• build: consolidate webui into main binary / docker image
• fix: set INITIAL_DATA_DIRECTORY better in tests
• ingest: normalize Entity after parse
• ofactest: use a "tiny ofac" record set, except for benchmarks
• search: grab read lock before ProcessSliceFn
• search: hide SimilarityScore fields when zero
• search: normalize addresses to improve search results

BUILD

• build: only run benchmarks on non-github authored commits
• build(deps): bump golang.org/x/net from 0.35.0 to 0.38.0

Release v0.51.2

BREAKING CHANGE

Watchman has undergone a complete overhaul of it's API endpoints, public models, search methodology, performance, and much more. We've redesigned Watchman to offer a unified endpoint and models to search sanctioned entities from any supported list. We encourage you to try out the new Watchman and report back any issues, comments, concerns you have.

This release contains a lot of changes so make sure to test, validate and verify your usage. Let us know in the #watchman slack room how the new version works for you. We are planning to make continual scoring improvements.

IMPROVEMENTS

• search: unified endpoint and model for all supported lists
• search: better performance for concurrently processing sanction lists
• search: integrate libpostal for address parsing and normalization

Release v0.50.10

IMPROVEMENTS

• postalpool: use msgpack over JSON for binary pool

BUILD

• build(deps-dev): bump nokogiri from 1.16.7 to 1.18.3 in /docs

Release v0.50.9

IMPROVEMENTS

• address: telemetry for all cases of ParseAddress
• ofactest: fix sample rate
• stringscore: make benchmark more consistent

Release v0.50.8

IMPROVEMENTS

• build: fixup benchmark ResetTimer calls
• norm: add BenchmarkPhoneNumber, track ./internal/norm/ benchmarks in graph
• ofactest: start on sampling OFAC data
• search: leverage query's .PreparedFields.Name in compareName
• search: normalize phone numbers
• search: precompute strings.Fields

Release v0.50.7

IMPROVEMENTS

• search: precompute normalized name, altnames
• search: remove ccache

Release v0.50.6

IMPROVEMENTS

• fix: normalize Country once
• minmaxmed: optimize implementation
• postalpool: better pooling by default, offer configurable knobs

BUILD

• fix(deps): update opentelemetry-go monorepo to v1.34.0