I need a set of tests for external clients to run against to prove they conform to a spec. I've been calling them "integration tests", but is there a better word for it? I'm not testing my software as much as creating an automated spec checker for other people's software.
@badtuple
Normally those are 'unit' tests. But it is a bit unear where your software sits.

@ljgww Ah, I can see that. When I think unit test I think internal units, not units from another codebase but I guess that might be an unnecessary constraint.

In terms of where my software sits, it's just a server that will be talked to by external clients created by various vendors. We need a way to verify their client meets expectation without having to jump in and manually inspect things. It's possible the "my code/their code" thing that made me ask the question is irrelevant.

@badtuple @ljgww Maybe "schema validation" or "configuration linter" is closer to what you want?
@badtuple
In such case since you'd test functionality of the server you can call it functional testing. Are writing api or Web site app or something else?
@badtuple
What you described is more acceptance testing
If you have a set of functions perhaps you can just describe the functionality to a prospect and allow him to do gap analysis