65 Followers
124 Following
372 Posts
network and systems security professional, part-time penetration tester, rowhome resident
I was thinking about "AI-assisted" coding, legal risk, and what it would mean to allow only "trivial" assistance (like formatting or "find the bug" interactive sessions) while disallowing "significant" contributions (like whole subroutines or larger blocks of code). I personally don't think it's possible to set aside the moral component of these models (stolen training data; excessive land, power, and water use and general "bad neighbor" habits; monopsony power in computer component acquisition) and I remain opposed to their use for that reason. But I think we have to assume that people who are already willing to overlook the moral component may also be willing to lie about provenance in order to land a contribution to a project.

Further, there are several large open questions about copyright in relation to agents. Is their training data truly unencumbered by copyright and licensing restrictions? Is their output copyrightable? Does even a "trivial" contribution by an agent invalidate the copyright of a larger code contribution that contains it? Is the user of a coding agent, or the user of the software generated by that agent, indemnified if the resulting code is later found to infringe a copyright or violate a license? Can an agent truly be said to output a "clean room implementation" of something when there is a non-zero chance that its training data contained the thing being reimplemented, and there is no way to verify that?

So, in general I'm against coding agents on moral grounds, and I'm also against them on legal grounds because I think any risk at all is too much risk. But on the other hand I'm intrigued by the question of "trivial" contributions, and I suspect that even projects that don't allow assistance from AI coding agents may have unwittingly accepted code that contained such "trivial" contributions. My questions are:

1. Is it possible for an AI-assisted code contribution to be "trivial" enough that it presents no legal risk, either now or in the future?
2. If so, how would you go about determining what's "trivial" and what's "significant?"
3. How could a contributor not just self-certify, but present verifiable evidence that a code contribution was legal and non-infringing and that any contribution from an agent met the "trivial" standard?
4. How could a company or open source project protect itself against a dishonest or bad faith actor who contributes code that later is found to infringe on a copyright or violate a license?
5. Who's going to pay for the damage if the worst case scenario comes to pass?

I don't have answers, but I suspect that the question of what constitutes a "trivial" contribution is going to matter a lot in the future.

corp drones: hey you with that team..please complete this SDLC required backout plan for your application

me: but I run the Pen Test team, we aren't an application.....

corp drones: you backout plan is now due in 59 days.

me: fine....he's an RPM that writes a file to /etc......happy now

corp drones: thank you for checking the box......we don't understand what an RPM is but if you have a backout plan we are happy.....

been playing with AI chats to take a create DB SQL, describe relationships and output an updated design ...... this isn't some over complex thing and so far all the free responses are shall we say lacking

RE: https://hachyderm.io/@tankgrrl/116242492898202209

dude... going to vibe code away all this COBOL in RUST using Claude Code.....what could go wrong?

A BIG problem I keep seeing is people who do NOT understand the scale involved in some systems / tasks.

when management thinks LLMs are creative it might be a sign....
corp laptop installs drive me NUTS...all the extra security tooling bloatware causes instability and the very modern hardware to just occasionally freeze when you push limits

RE: https://mas.to/@trendsbot/116211553284922724

Mr Landlord, do you know what the street value of these tokens are? And I'm willing to just given them to you in exchange for not evicting me.......

MFA fatigue ....... it is real and comes from the good place of we need to add MFA to X, the problem is when every X on a corp network asks for MFA .........
always good to learn that management is woefully ignorant of what your team actually does and is responsible for and is just a YES man for the whims of upper management.....