{
 "paper": {
  "id": "tse26-genai-usage",
  "title": "Self-Admitted GenAI Usage in Open-Source Software",
  "pdf": "evals/papers/tse26-genai-usage.pdf",
  "pages": 18
 },
 "broad_statements": [
  {
   "id": "B1",
   "quote": "For the 1,292 GenAI mentions we analyzed, developers mainly used GenAI tools for code generation, natural language translation, and code refactoring.",
   "page": 7,
   "section": "3.2.3 Purposes of GenAI Usage, Summary RQ1",
   "source": "rq_answer"
  },
  {
   "id": "B2",
   "quote": "Source code and documentation files were the dominant generation targets.",
   "page": 7,
   "section": "3.2.3 Purposes of GenAI Usage, Summary RQ1",
   "source": "rq_answer",
   "note": "The text and Table 5 order the content types differently. The sentence names source code and documentation files as dominant, while Table 5 (page 7) prints Commit messages under Project metadata with 1,003, Documentation files with 106, and the six source-file codes with 47, 45, 39, 21, 12, and 12."
  },
  {
   "id": "B3",
   "quote": "Acknowledgment of GenAI usage was a common purpose, sometimes combined with warnings about possible negative implications.",
   "page": 7,
   "section": "3.2.3 Purposes of GenAI Usage, Summary RQ1",
   "source": "rq_answer"
  },
  {
   "id": "B4",
   "quote": "Our results revealed that for most of the repositories analyzed, there was no significant change in code churn after GenAI adoption.",
   "page": 12,
   "section": "5.2 Results, Summary RQ3",
   "source": "rq_answer"
  },
  {
   "id": "B5",
   "quote": "Among the GenAI tasks identified in RQ1, generation tasks show a stronger impact on code churn than other tasks.",
   "page": 12,
   "section": "5.2 Results, Summary RQ3",
   "source": "rq_answer"
  },
  {
   "id": "B6",
   "quote": "We also observed recurring follow-up actions, including bug fixes, refactorings, reversions, and deletions, triggered by earlier GenAI-generated content.",
   "page": 16,
   "section": "9 Conclusion",
   "source": "conclusion",
   "note": "The boxed answer for RQ1 states this main result without a quantitative part in numbers or in words (page 7, \"Our analysis revealed patterns of corrective actions following code generation.\"), so the order passes over it and the conclusion sentence is quoted here, whose \"recurring\" rests on the counts in Section 3.2.1 on page 6."
  }
 ],
 "claims": [
  {
   "id": "C1",
   "quote": "Unsurprisingly, excluding PR-related activities, generation tasks were most common, with code generation being particularly prominent (105 instances).",
   "states": "Unsurprisingly, excluding PR-related activities, generation tasks were most common, with code generation being particularly prominent (105 instances).",
   "page": 5,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "serves": [
    "B1"
   ],
   "split_from": null,
   "selection_reason": "B1 says developers mainly used GenAI tools for code generation. If code generation were not the most frequent task apart from PR descriptions, B1 would name the wrong task first and would need substantial revision.",
   "note": "Table 3 (page 5) gives the code Code under the category Generation as 105, the same number as the sentence. Table 3 also gives PR description as 1,009, which the sentence excludes as a PR-related activity."
  },
  {
   "id": "C2",
   "quote": "Translation followed with 50 instances, while optimization and maintenance tasks accounted for 34 and 26 instances, respectively.",
   "states": "Translation followed with 50 instances, while optimization tasks accounted for 34 instances.",
   "page": 5,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "serves": [
    "B1"
   ],
   "split_from": "S1",
   "selection_reason": "B1 says developers mainly used GenAI tools for natural language translation and code refactoring, and these are the counts behind the second and third place of that ranking. If translation and optimization did not rank where the sentence puts them, B1 would name the wrong tasks and would need substantial revision.",
   "note": "B1 names code refactoring, and the only sentence with a number gives optimization, the category that holds it. Table 3 (page 5) prints the parts of both totals and no total: under Translation it gives Text 49 and Code 1, and under Optimization it gives Code refactoring 29 and Code improvement 5. The arithmetic is left to a later step. The sentence pairs its items with its numbers by \"respectively\", so the first number is optimization's and the second is maintenance's, which is how C2 and R1 divide it."
  },
  {
   "id": "C3",
   "quote": "Developers frequently use GenAI tools to modify source files (176 mentions).",
   "states": "Developers frequently use GenAI tools to modify source files (176 mentions).",
   "page": 7,
   "section": "3.2.2 Content Types",
   "serves": [
    "B2"
   ],
   "split_from": null,
   "selection_reason": "B2 says source code files were a dominant generation target. If source files were not the content type with the largest count outside the commit messages of the single PR-description repository, B2 would fail.",
   "note": "Table 5 (page 7) prints only the parts of this number, the six codes under Source files with 47, 45, 39, 21, 12, and 12, and no total. The arithmetic is left to a later step."
  },
  {
   "id": "C4",
   "quote": "However, other file types, such as documentation and configuration files, were also targeted (135 mentions).",
   "states": "However, other file types, such as documentation and configuration files, were also targeted (135 mentions).",
   "page": 7,
   "section": "3.2.2 Content Types",
   "serves": [
    "B2"
   ],
   "split_from": null,
   "selection_reason": "B2 says documentation files were a dominant generation target, and this is the only sentence that gives a number for them. If documentation files had barely been targeted, B2 would fail.",
   "note": "B2 names documentation files, and this sentence gives the number for the category that holds them. Table 5 (page 7) prints the parts of the sentence's 135 and no total: Documentation files 106, Configuration files 24, and Resource files 5. The arithmetic is left to a later step."
  },
  {
   "id": "C5",
   "quote": "Documentation and acknowledgment of GenAI usage emerged as the most frequent purpose.",
   "states": "Documentation and acknowledgment of GenAI usage emerged as the most frequent purpose.",
   "page": 7,
   "section": "3.2.3 Purposes of GenAI Usage",
   "serves": [
    "B3"
   ],
   "split_from": null,
   "selection_reason": "B3 says acknowledgment of GenAI usage was a common purpose. If this category were not the most frequent one, B3 would fail.",
   "note": "No sentence in the results or the discussion gives a count for this purpose. Table 6 (page 7) prints the codes of the category Documentation and Acknowledgment as Acknowledgement of usage 1,236, Acknowledge that the bug fix is related to AI-generated code 13, and Removal of Copilot comment 2, and gives no category total."
  },
  {
   "id": "C6",
   "quote": "We identified 20 mentions exhibiting this pattern of human actions triggered by an earlier GenAI action.",
   "states": "We identified 20 mentions exhibiting this pattern of human actions triggered by an earlier GenAI action.",
   "page": 6,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "serves": [
    "B6"
   ],
   "split_from": null,
   "selection_reason": "B6 says the study observed recurring follow-up actions triggered by earlier GenAI-generated content, and this count is what \"recurring\" rests on. If no mentions had shown the pattern, B6 would fail.",
   "note": "No table or figure reports this number."
  },
  {
   "id": "C7",
   "quote": "The most common follow-up activity was to fix bugs in AI-generated code (9).",
   "states": "The most common follow-up activity was to fix bugs in AI-generated code (9).",
   "page": 6,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "serves": [
    "B6"
   ],
   "split_from": null,
   "selection_reason": "B6 names bug fixes first among the recurring follow-up actions. If no follow-up action had been a bug fix, B6 would have to drop the item it names first and would need substantial revision.",
   "note": "No table or figure reports this number."
  },
  {
   "id": "C8",
   "quote": "In other cases, changes were reverted (1), AI-generated comments were deleted (2), or the generated code was commented out (1).",
   "states": "In other cases, changes were reverted (1), AI-generated comments were deleted (2).",
   "page": 6,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "serves": [
    "B6"
   ],
   "split_from": "S2",
   "selection_reason": "B6 names reversions and deletions among the recurring follow-up actions. If neither had occurred, B6 would have to drop two of the four items it names and would need substantial revision.",
   "note": "No table or figure reports these numbers. Table 6 (page 7) counts the purposes Revert 1 and Removal of Copilot comment 2, which is a different coding dimension."
  },
  {
   "id": "C9",
   "quote": "The average file-based code churn decreased from 0.17 to 0.06 with a significant difference (p < 0.05) and a medium effect (|δ| = 0.42), the average line-based churn decreased from 0.68 to 0.50 with a significant difference (p < 0.05) and a negligible effect (|δ| = 0.09).",
   "states": "The average file-based code churn decreased from 0.17 to 0.06 with a significant difference (p < 0.05) and a medium effect (|δ| = 0.42), the average line-based churn decreased from 0.68 to 0.50 with a significant difference (p < 0.05) and a negligible effect (|δ| = 0.09).",
   "page": 11,
   "section": "5.2 Results",
   "serves": [
    "B4"
   ],
   "split_from": null,
   "selection_reason": "B4 says there was no significant change in code churn after GenAI adoption for most repositories, and the discussion names the decreasing average churn as one of the two results it rests on (page 14, \"The overall trend we observed pointed in the opposite direction, i.e., we noticed a decreasing average code churn.\"). If the averages had risen instead, B4 would fail.",
   "note": "No table or figure reports these averages; Table 8 (page 11) reports the per-repository Wilcoxon effect sizes instead."
  },
  {
   "id": "C10",
   "quote": "We observed that only 26 (file-based) and 30 (line-based) repositories showed significant code churn trends (p < 0.05).",
   "states": "We observed that only 26 (file-based) and 30 (line-based) repositories showed significant code churn trends (p < 0.05).",
   "page": 12,
   "section": "5.2 Results",
   "serves": [
    "B4"
   ],
   "split_from": null,
   "selection_reason": "B4 says most of the repositories analyzed showed no significant change in code churn, and these counts are what \"most\" rests on. If most repositories had shown a significant trend, B4 would fail.",
   "note": "Table 9 (page 11) gives the same numbers: for file-based churn Sum sig. 26 and Not sig. 123, and for line-based churn Sum sig. 30 and Not sig. 119."
  },
  {
   "id": "C11",
   "quote": "Across all models, significant discontinuities are concentrated in the generation category, including the generation of code, test data, test methods, regular expressions, and comments. In contrast, optimization and maintenance tasks do not show consistent patterns.",
   "states": "Across all models, significant discontinuities are concentrated in the generation category, including the generation of code, test data, test methods, regular expressions, and comments. In contrast, optimization and maintenance tasks do not show consistent patterns.",
   "page": 12,
   "section": "5.2 Results",
   "serves": [
    "B5"
   ],
   "split_from": null,
   "selection_reason": "B5 says generation tasks show a stronger impact on code churn than other tasks, and this is the comparison behind it. If the significant discontinuities were spread evenly across the task categories, B5 would fail.",
   "note": "Table 10 (page 11) gives the counts the sentence describes without numbers: for file-based churn Generation 16 significant and 68 not significant, Optimization 2 and 12, Maintenance 1 and 2; for line-based churn Generation 15 and 69, Optimization 4 and 10, Maintenance 2 and 1. The two sides of one comparison are kept together, so the sentence pair is one claim."
  }
 ],
 "rejected": [
  {
   "id": "R1",
   "quote": "Translation followed with 50 instances, while optimization and maintenance tasks accounted for 34 and 26 instances, respectively.",
   "states": "Maintenance tasks accounted for 26 instances.",
   "page": 5,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "split_from": "S1",
   "reason": "B1 would still stand, because it names code generation, natural language translation, and code refactoring, and maintenance is not one of the categories it names.",
   "note": "Table 3 (page 5) prints the parts of the sentence's 26 and no total: Label revision 8, README revision 7, Document revision 4, Changelog revision 2, Prompt refinement 1, Color suggestion 1, Dependency upgrade 1, Version update 1, and Comment revision 1. The arithmetic is left to a later step. The sentence pairs its items with its numbers by \"respectively\", so the first number is optimization's and the second is maintenance's, which is how C2 and R1 divide it."
  },
  {
   "id": "R2",
   "quote": "In other cases, changes were reverted (1), AI-generated comments were deleted (2), or the generated code was commented out (1).",
   "states": "In other cases, the generated code was commented out (1).",
   "page": 6,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "split_from": "S2",
   "reason": "B6 would still stand, because it names bug fixes, refactorings, reversions, and deletions, and commenting code out is not one of the actions it names."
  },
  {
   "id": "R3",
   "quote": "Using this concept as a lens to study how GenAI tools are integrated into OSS projects, we analyze a curated sample of more than 200,000 GitHub repositories, identifying 1,292 such self-admissions across 156 repositories in commit messages, code comments, and project documentation.",
   "page": 1,
   "section": "Abstract",
   "reason": "Every number in this sentence describes the study: the size of the repository sample, the number of mentions identified, and the number of repositories they come from."
  },
  {
   "id": "R4",
   "quote": "Using a mixed methods approach, we derive a taxonomy of 32 tasks, 10 content types, and 11 purposes associated with GenAI usage based on 1,292 qualitatively coded mentions.",
   "page": 1,
   "section": "Abstract",
   "reason": "Every number in this sentence describes the study: the sizes of the code book and the number of coded mentions. The taxonomy itself is a qualitative finding."
  },
  {
   "id": "R5",
   "quote": "We then analyze 13 documents with policies and usage guidelines for GenAI tools and conduct a developer survey to uncover the ethical, legal, and practical concerns behind them.",
   "page": 1,
   "section": "Abstract",
   "reason": "Its only number, the 13 documents analyzed, describes the material of the study, and the concerns it reports are a qualitative finding."
  },
  {
   "id": "R6",
   "quote": "Finally, we examine the longitudinal impact of GenAI adoption on code churn in 151 repositories with self-admitted GenAI usage and find no general increase, contradicting popular narratives on the impact of GenAI on software development.",
   "page": 1,
   "section": "Abstract",
   "duplicate_of": [
    "B4"
   ],
   "reason": "Repeats the main result that B4 states, and its 151 is the number of repositories analyzed."
  },
  {
   "id": "R7",
   "quote": "We introduce self-admitted GenAI usage as an empirical lens for studying GenAI adoption in open-source software and curate a dataset of 1,292 self-admitted GenAI usages across 156 GitHub repositories.",
   "page": 2,
   "section": "1 Introduction, contribution list",
   "reason": "Every number in this sentence describes the study: the size of the curated dataset and the number of repositories it covers."
  },
  {
   "id": "R8",
   "quote": "Using a mixed-methods approach, we derive a taxonomy of GenAI usage comprising 32 development tasks, 10 content types, and 11 purposes, grounded in a qualitative analysis of the identified usages.",
   "page": 2,
   "section": "1 Introduction, contribution list",
   "reason": "Every number in this sentence is a size of the code book, which describes the study, and the taxonomy itself is a qualitative finding."
  },
  {
   "id": "R9",
   "quote": "We empirically analyze how open-source projects govern GenAI usage by examining 13 policies and usage guidelines, contextualized through a developer survey.",
   "page": 2,
   "section": "1 Introduction, contribution list",
   "reason": "Its only number, the 13 policies examined, describes the material of the study, and the sentence otherwise only announces an analysis."
  },
  {
   "id": "R10",
   "quote": "We assess the longitudinal impact of GenAI adoption on software evolution using a repository-level analysis of code churn in 151 projects, showing that GenAI adoption does not lead to a general increase in churn and that effects are stronger for generation tasks.",
   "page": 2,
   "section": "1 Introduction, contribution list",
   "duplicate_of": [
    "B4",
    "B5"
   ],
   "reason": "Repeats the two main results that B4 and B5 state, and its 151 is the number of projects analyzed."
  },
  {
   "id": "R11",
   "quote": "Our analysis revealed patterns of corrective actions following code generation.",
   "page": 7,
   "section": "3.2.3 Purposes of GenAI Usage, Summary RQ1",
   "duplicate_of": [
    "B6"
   ],
   "reason": "Repeats the main result that B6 states, without a quantitative part of its own."
  },
  {
   "id": "R12",
   "quote": "Another important purpose was regulation (see RQ2).",
   "page": 7,
   "section": "3.2.3 Purposes of GenAI Usage, Summary RQ1",
   "breaks_down": [
    "B3"
   ],
   "reason": "Adds a second purpose category to the purposes finding that B3 states, so it divides that result rather than stating one of its own.",
   "note": "Table 6 (page 7) gives the codes of the category Guidance and Best Practices as Set example 25, Exclusion of usage within the project 18, and Regulation of usage within the project 10; the sentence gives no number."
  },
  {
   "id": "R13",
   "quote": "We found 13 policies and guidelines on GenAI usage in open-source software projects, including strict policies prohibiting GenAI usage, policies requiring attribution, but also guidelines encouraging contributors to use GenAI, for example, for translating natural language text.",
   "page": 10,
   "section": "4.2.2 Developer Survey on GenAI Governance, Summary RQ2",
   "reason": "Its only number, the 13 policies analyzed, describes the material of the study, and the kinds of policy it lists are a qualitative finding."
  },
  {
   "id": "R14",
   "quote": "We did find 15 repositories with an overall upward trend in line-based code churn after the first GenAI mention. However, for most of them, the slope was negative.",
   "page": 12,
   "section": "5.2 Results, Summary RQ3",
   "breaks_down": [
    "B4"
   ],
   "reason": "Names the exception to the main result that B4 states, so it divides that result rather than stating one of its own.",
   "note": "The second sentence starts with \"However\" and refers to \"them\", so it is quoted together with the sentence before it. Table 9 (page 11) prints the parts of the sentence's 15 and no total: for line-based churn Upward with #Positive slope 5 (16.7%) and #Negative slope 10 (33.3%). The arithmetic is left to a later step."
  },
  {
   "id": "R15",
   "quote": "In addition, we also found 15 repositories with a downward trend.",
   "page": 12,
   "section": "5.2 Results, Summary RQ3",
   "breaks_down": [
    "B4"
   ],
   "reason": "Names a subgroup of the repositories behind the main result that B4 states, so it divides that result rather than stating one of its own.",
   "note": "Table 9 (page 11) prints the parts of the sentence's 15 and no total: for line-based churn Downward with #Positive slope 3 (10.0%) and #Negative slope 12 (40.0%). The arithmetic is left to a later step."
  },
  {
   "id": "R16",
   "quote": "Our initial sample of GitHub projects contained 207,062 repositories distributed across Python (77,542), JavaScript (48,500), TypeScript (37,424), Java (25,160), and C# (18,436).",
   "page": 2,
   "section": "2.1 Repository Sampling",
   "reason": "Gives the size of the initial repository sample, split by language, which describes the study.",
   "note": "Figure 1 (page 3) reports the same size as 207,062 repositories in step 1 of the data collection process."
  },
  {
   "id": "R17",
   "quote": "Our final sample of GitHub repositories, obtained in February 2024, contained 14,785 GitHub repositories distributed across Java (5,060), C# (3,544), TypeScript (2,464), Python (1,875), and JavaScript (1,842).",
   "page": 3,
   "section": "2.1 Repository Sampling",
   "reason": "Gives the size of the repository sample the results rest on, split by language, which describes the study.",
   "note": "Table 1 (page 3) gives the same size in its caption as n = 14,785, and Figure 1 (page 3) reports 14,785 repositories in step 2."
  },
  {
   "id": "R18",
   "quote": "Running the above retrieval process on all repositories yielded 3,004 mentions of GenAI tools: 1,572 in commit messages, 397 in source code comments, and 1,035 in documentation files.",
   "page": 4,
   "section": "2.2 Identifying Self-Admitted GenAI Usages",
   "reason": "Gives the number of mentions retrieved, split by artifact kind, which describes the material of the study.",
   "note": "Figure 1 (page 3) reports the same total as 3,004 mentions in step 3 and gives no split by artifact kind."
  },
  {
   "id": "R19",
   "quote": "We calculated a sample size of 341 mentions (of 3,004) to achieve estimates with a 95% confidence level and a 5% confidence interval.",
   "page": 4,
   "section": "2.2 Identifying Self-Admitted GenAI Usages",
   "reason": "Gives the size of the sample that the two authors labeled, which describes the study."
  },
  {
   "id": "R20",
   "quote": "The inspection resulted in disagreement between the two authors for only 14 cases (4% of the sample).",
   "page": 4,
   "section": "2.2 Identifying Self-Admitted GenAI Usages",
   "reason": "Counts the disagreements in the coding procedure, which describes the study rather than a result."
  },
  {
   "id": "R21",
   "quote": "The resulting 95% confidence interval was estimated to be (0.87, 0.95), indicating an “almost perfect” agreement.",
   "page": 4,
   "section": "2.2 Identifying Self-Admitted GenAI Usages",
   "reason": "Reports an inter-rater agreement score that supports the coding procedure, which describes the study."
  },
  {
   "id": "R22",
   "quote": "In total, we identified 1,292 true-positive mentions of GenAI tools that were aligned with our inclusion criteria. We found true-positive mentions in 156 repositories (11 Python, 12 JavaScript, 37 TypeScript, 47 C#, and 49 Java repositories).",
   "page": 4,
   "section": "2.2 Identifying Self-Admitted GenAI Usages",
   "reason": "Gives the size of the coded material and the number of repositories it comes from, split by language, which describes the study.",
   "note": "The two sentences are quoted together because the split by language belongs to the size that the first sentence states. Figure 1 (page 3) reports the same total as 1,292 usages in step 4."
  },
  {
   "id": "R23",
   "quote": "A preliminary analysis identified 1,008 mentions related to Copilot for Pull Requests.",
   "page": 4,
   "section": "3.1 Method",
   "reason": "Describes the composition of the coded material and which mentions were deferred during coding, not a result.",
   "note": "The quote leaves out the footnote marker attached to the last word."
  },
  {
   "id": "R24",
   "quote": "To build the code book, two authors independently analyzed 284 GenAI mentions.",
   "page": 4,
   "section": "3.1 Method",
   "reason": "Gives the size of the material used to build the code book, which describes the study.",
   "note": "The caption of Table 3 (page 5) gives the same number in n = 284 + 1,000 + 8 = 1,292."
  },
  {
   "id": "R25",
   "quote": "The analysis yielded “substantial” to “almost perfect” agreement levels on task (k = 0.81 − 0.89), content (k = 0.95 − 0.99), and purpose (k = 0.79 − 0.92), according to standard guidelines for interpreting k [20].",
   "page": 5,
   "section": "3.1 Method",
   "reason": "Reports inter-rater agreement scores that support the coding procedure, which describes the study."
  },
  {
   "id": "R26",
   "quote": "Our analysis identified 32 distinct task categories in which developers use GenAI tools in their workflows.",
   "page": 5,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "reason": "Gives the number of codes in the task code book, which describes the study."
  },
  {
   "id": "R27",
   "quote": "Our analysis identified three main categories of AI-generated content in open-source software projects, organizing ten dis[...]tinct codes (see Table 5).",
   "page": "6-7",
   "section": "3.2.2 Content Types",
   "reason": "Gives the number of categories and codes in the content code book, which describes the study.",
   "note": "The page break falls inside the word \"distinct\" and Tables 5 and 6 are printed between its two halves in text.txt."
  },
  {
   "id": "R28",
   "quote": "Our analysis identified 11 different purposes for GenAI mentions in software projects, grouped into four main categories (see Table 6).",
   "page": 7,
   "section": "3.2.3 Purposes of GenAI Usage",
   "reason": "Gives the number of codes and categories in the purpose code book, which describes the study."
  },
  {
   "id": "R29",
   "quote": "This manifested itself in several ways, such as offering guidance (53 mentions), flagging areas needing attention (23 mentions), and addressing GenAI limitations (4 mentions).",
   "page": 7,
   "section": "3.2.3 Purposes of GenAI Usage",
   "reason": "B3 would still stand, because it states that acknowledgment was a common purpose and these are the counts of the three other purpose categories.",
   "note": "Table 6 (page 7) prints only the per-code counts and no category totals: for Guidance and Best Practices 25, 18, and 10; for Quality Assurance 11, 10, and 2; for GenAI Limitations 3 and 1. The arithmetic is left to a later step."
  },
  {
   "id": "R30",
   "quote": "Of the 1,009 instances of code PR description in Table 3, 1,000 originated from a single repository and are discussed separately above.",
   "page": 6,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "reason": "Describes how the coded material is distributed over repositories, which describes the study.",
   "note": "Table 3 (page 5) gives PR description as 1,009, the same number as the sentence."
  },
  {
   "id": "R31",
   "quote": "Among them, 13 referred to code that was initially generated using GenAI tools and then changed.",
   "page": 6,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "reason": "B6 would still stand, because this is the count for a subgroup of the 20 follow-up actions that C6 gives."
  },
  {
   "id": "R32",
   "quote": "In addition to the 13 human actions that followed AI code generation that we discussed above, we found seven human actions following the generation of configuration and validation files or an unclear role of the GenAI tool.",
   "page": 6,
   "section": "3.2.1 GenAI-Assisted Tasks",
   "reason": "B6 would still stand, because this is the count for the remaining subgroup of the 20 follow-up actions that C6 gives."
  },
  {
   "id": "R33",
   "quote": "Using our sample of GenAI mentions, we found 28 mentions related to policies and usage guidelines around GenAI tool usage.",
   "page": 8,
   "section": "4.1 Method",
   "reason": "Gives the number of mentions that the RQ2 analysis rests on, which describes the study."
  },
  {
   "id": "R34",
   "quote": "Table 7 presents detailed examples drawn from 13 documentation files and commit messages in 12 GitHub repositories, where the last column indicates the number of mentions identified in the software artifact.",
   "page": 8,
   "section": "4.1 Method",
   "reason": "Gives the number of policy documents and repositories that the RQ2 analysis rests on, which describes the study.",
   "note": "Table 7 (page 9) lists thirteen policies, P1 to P13, and their last column gives the per-artifact mention counts 1, 1, 1, 9, 1, 1, 1, 1, 4, 1, 1, 1, and 5."
  },
  {
   "id": "R35",
   "quote": "We were able to determine the email addresses of 30 contributors. In total, we received eight survey responses, which we analyzed using a combination of open coding and card sorting.",
   "page": 8,
   "section": "4.1 Method",
   "reason": "Gives the number of contributors contacted and the number of survey responses analyzed, which describes the study.",
   "note": "The two sentences are quoted together because the response count is read against the number contacted."
  },
  {
   "id": "R36",
   "quote": "Five developers highlighted the necessity of regulating the usage of GenAI tools in software projects.",
   "page": 8,
   "section": "4.2.2 Developer Survey on GenAI Governance, General GenAI Usage Guidance",
   "reason": "No broad statement states the main result that it would serve: the survey findings of RQ2 are qualitative and the record has no broad statement for them.",
   "note": "The discussion builds on this count without a number (page 13, \"Moreover, a majority of our survey participants agreed that the regulation of GenAI usage is necessary in open-source projects.\"), and the boxed answer for RQ2 (page 10) states only the kinds of policy found."
  },
  {
   "id": "R37",
   "quote": "Moreover, a majority of our survey participants agreed that the regulation of GenAI usage is necessary in open-source projects.",
   "page": 13,
   "section": "6.2 RQ2: Existing Guidelines for GenAI Usage",
   "duplicate_of": [
    "R36"
   ],
   "reason": "Repeats the count that R36 gives, in words, and no broad statement states the main result that it would serve."
  },
  {
   "id": "R38",
   "quote": "We included 151 repositories with true positive GenAI mentions that did not prohibit the use of GenAI tools.",
   "page": 10,
   "section": "5.1 Method",
   "reason": "Gives the number of repositories that the RQ3 analysis rests on, which describes the study.",
   "note": "The caption of Table 8 (page 11) gives the same size as n = 151, and Figure 1 (page 3) reports 151 repositories for the RDD analysis in step 4."
  },
  {
   "id": "R39",
   "quote": "For the 149 repositories included, we identified four patterns, that we describe in the following:",
   "page": 11,
   "section": "5.1 Method",
   "reason": "Gives the number of repositories that the RDD analysis rests on, which describes the study.",
   "note": "The caption of Table 9 (page 11) gives the same size as n = 149."
  },
  {
   "id": "R40",
   "quote": "Of the 151 repositories with self-admitted GenAI usage, 119 had a significant difference in file-based churn, and 120 had a significant difference in line-based churn (p < 0.05).",
   "page": 11,
   "section": "5.2 Results",
   "reason": "B4 would still stand, because its first sentence summarises the RDD trend analysis, whose counts C10 gives from Table 9, while this sentence reports the Wilcoxon signed-rank comparison of Table 8.",
   "note": "Table 8 (page 11) gives the same numbers in its Sum sig. column, 119 for file-based and 120 for line-based churn, against 32 and 31 not significant. The two analyses count significant repositories differently: Table 8 (page 11) gives 119 of 151 and 120 of 151 as significant under the Wilcoxon signed-rank test, and Table 9 (page 11) gives 26 of 149 and 30 of 149 as significant under the RDD analysis. The sentences following B4's first one, in the Summary RQ3 box on page 12, give 15 repositories with an upward trend and 15 with a downward trend, the numbers the RDD paragraph on page 12 reports."
  },
  {
   "id": "R41",
   "quote": "Eleven repositories had an increasing file-based churn with a medium-to-large effect size, and 15 had an increasing line-based churn with a medium-to-large effect size.",
   "page": 11,
   "section": "5.2 Results",
   "reason": "B4 would still stand, because these are the counts for one effect-size subgroup of the repositories in Table 8.",
   "note": "Table 8 (page 11) prints the parts of both numbers and no combined medium-to-large row: for file-based churn the increasing counts are medium 9 and large 2, and for line-based churn medium 7 and large 8. The arithmetic is left to a later step."
  },
  {
   "id": "R42",
   "quote": "A decreasing churn was more common: 49 repositories had a decreasing file-based churn with a medium-to-large effect size, and 49 repositories had a decreasing line-based churn with a medium-to-large effect size.",
   "page": 11,
   "section": "5.2 Results",
   "reason": "B4 would still stand, because these are the counts for one effect-size subgroup of the repositories in Table 8.",
   "note": "Table 8 (page 11) prints the parts of both numbers and no combined medium-to-large row: for file-based churn the decreasing counts are medium 23 and large 26, and for line-based churn medium 24 and large 25. The arithmetic is left to a later step."
  },
  {
   "id": "R43",
   "quote": "For file-based churn, an overall upward trend with a negative slope after the cutoff date was most common (12 repositories).",
   "page": 12,
   "section": "5.2 Results",
   "reason": "B4 would still stand, because this is the count for one of the four RDD patterns rather than the result as a whole.",
   "note": "Table 9 (page 11) gives the same number for file-based churn, Upward trend with #Negative slope 12 (46.2%)."
  },
  {
   "id": "R44",
   "quote": "For line-based churn, an overall downward trend with a negative slope was most common (12 repositories). However, there were almost as many repositories (10) with an overall downward trend, but a positive slope after the cutoff date.",
   "page": 12,
   "section": "5.2 Results",
   "reason": "B4 would still stand, because these are the counts for two of the four RDD patterns rather than the result as a whole.",
   "note": "The text and Table 9 put the 10 repositories in different patterns. The sentence gives them as an overall downward trend with a positive slope after the cutoff date, while Table 9 (page 11) prints 10 (33.3%) for line-based churn under Upward trend with #Negative slope and prints 3 (10.0%) under Downward trend with #Positive slope. Table 9 gives the sentence's 12 as Downward trend with #Negative slope 12 (40.0%). The second sentence starts with \"However\" and is quoted with the sentence before it."
  },
  {
   "id": "R45",
   "quote": "We found 15 repositories with a significant upward trend in file-based churn and 15 with a significant upward trend in line-based churn. However, most of them had a negative slope.",
   "page": 12,
   "section": "5.2 Results",
   "reason": "B4 would still stand, because these are the counts for the repositories that are the exception to it.",
   "note": "Table 9 (page 11) prints the parts of both numbers and no trend totals: for file-based churn Upward with #Positive 3 (11.5%) and #Negative 12 (46.2%), and for line-based churn Upward with #Positive 5 (16.7%) and #Negative 10 (33.3%). The arithmetic is left to a later step. The second sentence refers to \"them\" and is quoted with the sentence before it."
  },
  {
   "id": "R46",
   "quote": "In addition, 11 projects had a significant downward trend in file-based churn and 15 had a significant downward trend in line-based churn.",
   "page": 12,
   "section": "5.2 Results",
   "reason": "B4 would still stand, because these are the counts for one of the trend directions rather than the result as a whole.",
   "note": "Table 9 (page 11) prints the parts of both numbers and no trend totals: for file-based churn Downward with #Positive 4 (15.4%) and #Negative 7 (26.9%), and for line-based churn Downward with #Positive 3 (10.0%) and #Negative 12 (40.0%). The arithmetic is left to a later step."
  },
  {
   "id": "R47",
   "quote": "We cannot conclude that there is a general trend toward increasing code churn.",
   "page": 12,
   "section": "5.2 Results",
   "duplicate_of": [
    "B4"
   ],
   "reason": "Repeats the main result that B4 states, without a number of its own."
  },
  {
   "id": "R48",
   "quote": "Therefore, with our data and methodology, we cannot confirm this claim.",
   "page": 12,
   "section": "5.2 Results",
   "duplicate_of": [
    "B4"
   ],
   "reason": "Repeats the main result that B4 states, as a verdict on the GitClear claim."
  },
  {
   "id": "R49",
   "quote": "In summary, this task-level analysis reveals that GenAI-assisted generation tasks appear more rework-prone than other forms of assistance.",
   "page": 12,
   "section": "5.2 Results",
   "duplicate_of": [
    "B5"
   ],
   "reason": "Repeats the main result that B5 states, without a number of its own."
  },
  {
   "id": "R50",
   "quote": "Our analysis revealed that developers primarily use GenAI tools for code generation, natural language translation, and code refactoring.",
   "page": 13,
   "section": "6.1 RQ1: Reasons for Mentioning GenAI Tools",
   "duplicate_of": [
    "B1"
   ],
   "reason": "Repeats the main result that B1 states, without the counts."
  },
  {
   "id": "R51",
   "quote": "In addition to code generation, we found that internationalization and natural language translation are common use cases for LLMs in open-source software projects (49 instances, see Table 3).",
   "page": 13,
   "section": "6.1 RQ1: Reasons for Mentioning GenAI Tools",
   "reason": "B1 would still stand, because this gives the count for the natural-language part of the translation category whose count C2 gives.",
   "note": "The text gives the translation count differently in two places: this sentence gives 49 instances (page 13) and the results sentence of C2 gives 50 instances (page 5). Table 3 (page 5) prints Translation as Text 49 and Code 1."
  },
  {
   "id": "R52",
   "quote": "Contrary to claims [...] in the GitClear report, which was extensively discussed in the software development community [36, 37], we did not find an increasing code churn after GenAI adoption.",
   "page": "13-14",
   "section": "6.3 RQ3: Impact of GenAI Usage on Code Churn",
   "duplicate_of": [
    "B4"
   ],
   "reason": "Repeats the main result that B4 states, without a number of its own.",
   "note": "A footnote is printed between the two halves of the sentence in text.txt at the page break."
  },
  {
   "id": "R53",
   "quote": "They found that approximately 54% of the generated code lines were integrated and only 2.5% of the generated snippets were later modified.",
   "page": 14,
   "section": "6.3 RQ3: Impact of GenAI Usage on Code Churn",
   "reason": "Reports the results of cited work, which the paper sets beside its own churn result, not a result of this study."
  },
  {
   "id": "R54",
   "quote": "However, our RDD analysis revealed that three repositories (3/26, 11.5%) had a significant upward file-based code churn trend with a positive slope (p < 0.05).",
   "page": 14,
   "section": "6.3 RQ3: Impact of GenAI Usage on Code Churn",
   "reason": "B4 would still stand, because this is the count for one of the four RDD patterns and the paper presents it as the exception to that result.",
   "note": "Table 9 (page 11) gives the same number for file-based churn, Upward trend with #Positive slope 3 (11.5%)."
  },
  {
   "id": "R55",
   "quote": "To contextualize this finding, we note that a larger proportion of repositories (12/26, 46.2%) showed an upward trend with a negative slope, i.e., churn increased, but the increase decelerated over time.",
   "page": 14,
   "section": "6.3 RQ3: Impact of GenAI Usage on Code Churn",
   "reason": "B4 would still stand, because this is the count for one of the four RDD patterns rather than the result as a whole.",
   "note": "Table 9 (page 11) gives the same number for file-based churn, Upward trend with #Negative slope 12 (46.2%)."
  },
  {
   "id": "R56",
   "quote": "In addition, 26.9% (7/26) showed downward trends.",
   "page": 14,
   "section": "6.3 RQ3: Impact of GenAI Usage on Code Churn",
   "reason": "B4 would still stand, because this is the count for one of the four RDD patterns rather than the result as a whole.",
   "note": "The text and Table 9 give the share of downward trends differently. The sentence gives 26.9% (7/26) for downward trends, while Table 9 (page 11) prints file-based Downward as #Positive slope 4 (15.4%) and #Negative slope 7 (26.9%), so the sentence's figure matches the negative-slope row alone."
  },
  {
   "id": "R57",
   "quote": "The 2025 follow-up report [52], based on an expanded dataset of 211 million lines through 2024, reported a rise in code churn from 4.5% in 2023 to 5.7% in 2024, a 39.9% drop in refactoring, and a 17.1% increase in copy-pasted code.",
   "page": 15,
   "section": "7.3 GenAI Impact on Software Development",
   "reason": "Reports the results of cited work, which the paper sets beside its own churn result, not a result of this study."
  },
  {
   "id": "R58",
   "quote": "In our mixed-methods study design, we first mined more than 200,000 GitHub repositories, isolating 1,292 true-positive GenAI mentions across 156 projects.",
   "page": 16,
   "section": "9 Conclusion",
   "reason": "Every number in this sentence describes the study: the size of the repository sample, the number of mentions, and the number of projects."
  },
  {
   "id": "R59",
   "quote": "Qualitative open coding of these instances and subsequent card sorting yielded taxonomies of 32 assisted tasks, 10 content types, and 11 usage purposes.",
   "page": 16,
   "section": "9 Conclusion",
   "reason": "Every number in this sentence is a size of the code book, which describes the study, and the taxonomies themselves are a qualitative finding."
  },
  {
   "id": "R60",
   "quote": "We complemented this content analysis with a survey of project contributors and a systematic review of 13 project-level policies and guidelines.",
   "page": 16,
   "section": "9 Conclusion",
   "reason": "Its only number, the 13 policies reviewed, describes the material of the study."
  },
  {
   "id": "R61",
   "quote": "In addition, we performed a regression-discontinuity (RDD) analysis of code churn in the 149 repositories that contained sufficient data to study the impact of GenAI adoption on open source software projects.",
   "page": 16,
   "section": "9 Conclusion",
   "reason": "Its only number, the 149 repositories, is the size of the material the RDD analysis rests on, which describes the study."
  },
  {
   "id": "R62",
   "quote": "The RQ1 results show that developers most often use GenAI for code generation, natural-language translation, and refactoring—with explicit acknowledgment as the dominant purpose.",
   "page": 16,
   "section": "9 Conclusion",
   "duplicate_of": [
    "B1",
    "B3"
   ],
   "reason": "Repeats the two main results that B1 and B3 state, without the counts."
  },
  {
   "id": "R63",
   "quote": "Together with our RQ3 task-level analysis, which shows that generation tasks are more rework-prone than optimization or maintenance, this suggests that GenAI output has a provisional nature.",
   "page": 16,
   "section": "9 Conclusion",
   "duplicate_of": [
    "B5"
   ],
   "reason": "Repeats the main result that B5 states, as the ground for an implication."
  },
  {
   "id": "R64",
   "quote": "While acknowledgment of GenAI usage is common (RQ1), contextual metadata such as prompts, model versions, or scope of generation is rarely recorded.",
   "page": 16,
   "section": "9 Conclusion",
   "reason": "Cannot tell what the frequency word \"rarely\" rests on, so it is recorded here for the checker.",
   "note": "The paper gives no count for how often the generation context is documented. The discussion states the same in words (page 13, \"A more standardized approach for documenting GenAI contributions is required, since most self-admitted GenAI usages did not document the generation context beyond brief summaries.\"), and the codes of Table 6 (page 7) count purposes, not whether a mention records prompts, model versions, or the scope of generation."
  },
  {
   "id": "R65",
   "quote": "The RQ3 results show no systematic increase in code churn after GenAI adoption, contradicting prominent industry claims.",
   "page": 16,
   "section": "9 Conclusion",
   "duplicate_of": [
    "B4"
   ],
   "reason": "Repeats the main result that B4 states, without a number of its own."
  }
 ]
}