Rendered at 17:30:56 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
prologic 2 hours ago [-]
What is the point collecting this data? I feel like this is like "A list of N,NNN repositories using IDE(s)" Hmmm I don't get it?
tay1or 2 hours ago [-]
The data was collected for a paper that was attempting to find a lexical difference between human contributions and LLM contributions. The reason for this was because repository maintainers need to make sure submitted code has been at least reviewed by a human. By detecting unattributed AI submissions, it can tell maintainers that they need to pay extra attention to the repositories.
prologic 25 minutes ago [-]
And does that work? Can you genuinely tell whether a human has reviewed Ai-assisted/generated code?
naruhodo 2 hours ago [-]
So that this list can be added to the list of lists.
tay1or 55 minutes ago [-]
you got me, this is the real point of the list
deckar01 2 hours ago [-]
There has been a persistent attack on GitHub repos by agents trying to land a commit to become a contributor. The default GitHub permission is to allow contributors to execute actions against the repo’s compute budget, so it could be a botnet. Another possibility is that they are trying to get a Copilot grant. Someone claiming to be in academia was surveying repos when that program first started. I’m guessing the permissions for that are equally as naive.
lioeters 3 hours ago [-]
Related paper in the repo:
Changes in Vocabulary Between Human-created and LLM-assisted Code Repositories - Taylor Lineman
Also seems to consist of directly AI adjacent topics from a quick skim
tay1or 2 hours ago [-]
This surprised me as well when I wrote the paper! I started data collection for the AI assisted repositories on May 1, 2025 which is the release data of claude code. The reasoning behind this is noted in the paper but can be broken down to, it would be easier to find a large quantity of AI repositories after vibe coding took off. The majority of these repos being AI adjacent topics was an interesting find, but supports the idea that a large chunk of our LLM advancements are being helped by LLMs.
deckar01 1 hours ago [-]
When I suspect an agent opening a PR I check their GitHub activity. They have usually opened dozens of PRs. Most of them are ignored, high profile packages close them, and AI related projects blindly merge them. They also tend to create dozens of private repos and commit to them non-stop.
Changes in Vocabulary Between Human-created and LLM-assisted Code Repositories - Taylor Lineman
https://raw.githubusercontent.com/ActuallyTaylor/strata/refs... (PDF)